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f  k 

For  control  systems  of  the  form  x  *  X(x)  +  £  Y  (x)u. ,  a  strengthened 

i-1  1  1 

version  of  the  classical  Pontryagin  Maximum  Principle  is  proved.  The 
necessary  condition  for  optimality  given  here  is  obtained  using  functional 
analytic  techniques  and  quite  general  high-order  perturbations  of  the 
reference  control.  As  shown  by  an  example,  our  test  is  particularly  effective 
when  applied  to  bang-bang  controls,  a  case  where  other  high-order  tests  do  not 
provide  additional  information. 
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SIGNIFICANCE  AND  EXPLANATION 


The  determination  of  optimal  controls  is  the  primary  problem  in  control 
theory.  The  most  effective  tool  in  this  respect  is  Pontryagin' s  Maximum 
Principle,  which  provides  necessary  conditions  for  optimality,  thus  restrict¬ 
ing  the  search  to  a  small  set  of  candidates  among  which  the  optimal  control  is 
more  easily  found. 

In  cases  where  Pontryagin' s  test  does  not  yield  sufficient  information, 
more  refined  necessary  conditions  are  known,  for  example  Kroner's  High-order 
Maximum  Principle.  The  high-order  test  discussed  in  this  paper  states  further 
necessary  conditions  for  optimality  and  can  be  particularly  useful  when 
applied  to  bang-bang  controls,  a  case  often  encountered  in  the  applications, 
where  other  high-order  tests  are  generally  ineffective. 

A; 


The  responsibility  for  the  wording  and  views  expressed  in  this  descriptive 
summary  lies  with  MRC,  and  not  with  the  author  of  this  report. 
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A  HIGH -ORDER  TEST  FOR  OPTIMALITY  OF  BANG-BANG  CONTROLS 


Alberto  Breaean 


1 .  Introduction 


Let  U  be  a  closed  convex  subset  of  the  Banach  space  (■*  ( [0,T]  irf1)  and 
consider  a  continuously  Frechet  differentiable  mapping  $  :  U  ♦  Rn .  Given 
u  e  U,  in  this  paper  we  give  a  hlgh-order  sufficient  condition  for  +(u)  to 
belong  to  the  interior  of  the  Image  t(U).  Problems  of  this  kind  arise 
frequently  in  control  theory.  Indeed,  consider  a  control  system  of  the  form 
x(t)  -  f ( x( t ) )  +  G(x(t) )u(t)  , 

(S) 

x(0)  -  0,  u(t)  e  0  for  a.e.  t  C  [0,T]  , 

where  Q  is  a  compact  convex  subset  of  sF1  and  f,  G  are  C1  mappings 
from  R°  into  tf1  and  x  R*  respectively.  If  T  is  small  enough,  then 
(S)  yields  a  C1  map  ♦  :  u  x(T,u)  from  the  set  U  of  admissible  controls 
into  if1.  Here  x(T,u)  is  the  point  reached  at  time  T  by  the  solution  of 
(S)  corresponding  to  the  control  u.  A  classical  problem  is  the  following: 
given  an  acbalssible  control  u,  decide  whether  u  is  time  optimal.  This  is 
often  equivalent  to  showing  that  x(T,u)  lies  on  the  boundary  of  the 
reachable  set  R(T ) . 

A  well  known  necessary  condition  for  optimality  is  given  by  the 
Fontryagin  Maximum  Principle  (PMP)  [2,8].  Kroner's  high  order  maximum 
principle  (HMP)  [6]  provides  further  conditions,  obtained  from  the  study  of 
more  general  one  parameter  perturbations  u^  of  the  control  u.  if  the  first 


order  variation  at  the  terminal  point  of  the  trajectory 

lim  [x(T,u_ )  -  xtT/iDJ/C 
$♦0  * 


(1.1) 
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vanish**,  a  high  order  tangent  vector  can  be  generated,  and  additional 
necessary  conditions  for  extremality  are  found.  This  method  yielded  several 
new  results  [3,4, 5,6],  especially  concerning  the  problem  of  local  stability. 

In  this  case,  the  reference  control  is  u(t)  =  0  and  lies  in  the  interior  of 
fi  “  [-1,+t].  Hence  there  are  several  ways  to  locally  perturb  17  and  achieve 
a  cancellation  in  the  first  order  variation  (1.1).  The  BMP  can  be  here 
particularly  effective.  On  the  other  hand,  if  u  is  bang-bang,  u(t) 
already  lies  on  the  boundary  of  0,  and  only  one-sided  perturbations  of  u 
are  admissible.  As  a  result,  in  general  there  is  no  way  of  generating  high 
order  tangent  vectors,  as  long  as  only  the  "instantaneous"  control  variations 
considered  in  [5,6]  are  used.  In  order  to  develop  a  genuine  high  order  test 
for  bang-bang  controls,  it  is  necessary  to  achieve  the  cancellation  of  the 
first  order  variation  (1.1)  by  perturbing  "u  simultaneously  in  the  neighbor¬ 
hoods  of  two  or  more  distinct  times.  This  leads  us  to  consider  more  general 
control  variations. 

In  the  following,  the  variable  t  always  denotes  time,  while  €,  c  are 
used  as  variational  parameters:  u{£,»)  or  u(c,€,« )  will  denote  controls  in 
L1([0,T]>^)  depending  continuously  on  the  parameters  £,  c.  In  the  abstract 
setting  considered  in  sections  2  and  3,  the  control  u  is  regarded  merely  as 
a  point  in  a  Banach  space  E,  and  we  use  the  shorter  notation  u(£)  or 
u(c,€)  to  indicate  its  dependence  on  one  or  two  parameters. 

Definition  1.  A  one-parameter  admissible  variational  family  of  control 
functions  (AVF)  for  a  control  u  on  [0,T],  generating  a  tangent  vector 
v  e  sP,  is  a  continuous  map  y  t  C  ♦  u(C,*>  from  a  nondegenerate  interval 
[0,1]  into  [^([OjTlirf1)  such  that 

u(0,*)-uC)  ,  u|(,M  e  0  V  e  e  10, Cl  ,  (1.2) 

lim  [x(T,u(€ ,*  ) )  -  x(T,'u(,))]/C  ■  v  .  (1.3) 

O0 
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We  say  that  the  AVF  Y  has  order  h  if  there  exist  constants  »  C2  for 


which 

0  <  c,  <  C'1  «u<e,*)  -  TSC- )»h^  <  C,,  V  ?  e  (0,£]  .  (1.4) 

1  i.1  2 

Notice  that  one  can  recover  every  high  order  tangent  vector  by  means  of  the 
first  order  derivative  (1.3),  via  a  suitable  change  of  the  parameter  £.  As 
shown  in  [5],  this  method  differs  from  Kroner's  only  in  computational  ease. 

The  above  class  of  AVF  is  at  the  same  time  simpler  and  more  general  than  those 
studied  in  [5,6],  hence  the  corresponding  family  of  tangent  vectors  can  be 
much  larger.  One  would  like  to  use  all  of  these  vectors  to  derive  a  stronger 
HMP. 

Assume  that,  given  suitable  variational  families  Y^  for  7(i“0, . . . ,k) , 
the  positive  span  of  the  corresponding  tangent  vectors  v^  is  all  of  iP .  To 
conclude  that  x(T,u)  lies  in  the  interior  of  the  reachable  set  R  (T) ,  one 
has  to  construct  approximate  convex  combinations  of  the  v^  continuously 
depending  on  the  parameters.  More  precisely,  the  Y^  should  be  summable  in 
the  sense  of 

Definition  2.  Let  F  -  (Y0»»..#Yk}  be  a  finite  collection  of  AVF  for  the 
control  7,  generating  the  tangent  vectors  Vq,...,^.  Set 

k 

A*  -  {c  -  (c_,...,c  );  c  >  0,  l  c  *  1}  .  (1.5) 

*  i*0 

F  is  summable  if  there  exist  C  >  0  and  a  continuous  map  (c,£)  ♦  u(c,£,*) 
from  A*  x  [0,d  into  L1  ( (0,T]  ilP)  such  that,  for  all  c  e  A* 

u(c, 0, •)•«(•),  u(c,C,*)  »  (  e  [0,{]  ,  (1.6) 


k 

lim  [x(T,u(c,5»* ) )  -  x(T,u(»))]/C  *  I  c.v. 

$♦0  i-0  1  1 

(1.7) 

uniformly  on  A* 
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This  crucial  property  holds  for  control  variations  of  ths  special  kind 
considered  in  [5,6],  but  is  not  satisfied  by  an  arbitrary  collection  of  AVF 
(see  $5  for  a  counterexample).  Our  key  result  is  that  if  all  but  one  of  the 
6  F  have  order  1,  then  F  is  sunmable.  This  is  first  proven  in  an 
abstract  setting,  then  stated  for  the  control  system  (S).  We  thus  obtain  a 
strengthened  version  of  the  PMP  which  is  particularly  effective  when  applied 
to  bang- bang  controls.  Indeed,  our  single  high  order  variation  is  allowed  to 
be  quite  arbitrary.  An  application  of  this  technique  is  given  in  §5. 

2.  Notations,  statement  of  the  main  results. 

Consider  a  mapping  4  from  a  neighborhood  of  a  closed  subset  0  of  a 
Banach  space  E  into  rf1  and  denote  by  D+(u)  its  differential  at  u.  We 
say  that  4  1*  C1  if  the  map  u  ♦  D+(u)  from  E  into  the  space  of 
continuous  linear  operators  t(E,^*)  is  continuous.  For  the  definition  of 
the  operator  norm  on  ME,^1)  and  for  the  basic  properties  of  differentials 
our  general  reference  is  Oiiudonne  [1]. 

If  u  e  II,  by  an  admissible  variational  family  (AVF)  for  u generating 
a  tangent  vector  v  e  rf1,  we  mean  a  continuous  map  T  >  ?  ♦  u( £ )  from  [0,1] 
into  U  such  that 

u(0)  «u,  U{()  eu  v  5  e  [0,1]  ,  (2.D 

lim  t4(u(£) )  -  4(u)]/£  -  v  .  (2.2) 

£♦0 

If,  for  some  0  <  <  •  and  all  £  e  (0,1], 

C,  <  £‘1lu(£)  -  u»h  <  C2  (2.3) 

we  say  that  Y  has  order  h.  We  write  B(x,r)  for  the  closed  ball  centered 
at  x  with  radius  r.  The  Euclidean  norm  on  R11  and  the  operator  norm  on 
the  set  of  n  *  m  matrices  are  both  written  as  | • | ,  while  double  bars  are 
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used  for  the  norms  1*1  in  Banach  spaces  such  as  B  or  L(B,B^).  Int  A, 
dA,  co  A  denote  the  interior,  the  boundary  and  the  convex  closure  of  a  set 
A.  With  these  conventions  we  have 

Theorem  1  -  Let  U  be  a  closed  convex  subset  of  a  Banach  space  B,  and  let 
4  be  a  C1  mapping  from  a  neighborhood  of  U  into  nP.  Assume  ue  II  and 
let  ♦  u^tC)  be  A VP  of  TT  generating  the  tangent  vectors  v^ 

(i*0,...,k).  If  0  e  int  co{vQ,. . . ,v^>  £  Rn  and  Yj#»»»»Yk  have  order  1, 
then  $(«D  e  int  $(U). 

Prom  this  result,  a  sharper  form  of  Pontryagin's  maximum  principle  for 
the  system  (S)  can  be  derived.  To  fix  the  ideas,  assume  that  f  and  G 
are  C1  on  B(0,r)  £  *nj  fx»  Gx  will  denote  partial  derivatives.  Let 
sup{|f(x)|,  |G(x) | ;  x  e  B(0,r ) }  <  M y 

sup{|wh  w  e  fl}  <  M2,  0  <  T  <  (M1  +  M1M2)"1r  . 

This  guarantees  that,  for  every  control  u  e  L1  ( [0,T] jrf“)  taking  values  in 

0,  lul  <  MjT  and  there  exists  a  unique  solution  t  ♦  x(t,u)  of  (S)  defined 

on  [0,T] ,  taking  values  inside  B(0,r).  Notice  that  the  open  ball 

8  *  {u  e  L^jlul  <  M2t)  is  a  neighborhood  of  the  set  of  admissible  controls 

U  *  {u  e  L* ( 10, T]  iR®);  u(t)  e  tl  a.e.  in  [0,T]}  . 

We  assume  that  fl  is  closed,  bounded  and  convex,  thus  the  same  holds  for  U . 

0  n 

The  map  ♦  :  8  ♦  C  (tO,T];K  )  that  associates  to  each  control  u  the 
corresponding  solution  x(*,u)  of  (S)  is  continuously  Prichet  differentiable. 
Indeed  ♦  i*  implicitly  defined  by  the  equation  <*(u)  “  f(u,^(u)),  with 

T(u,x) (t)  -  f(x(s))ds  +  G(x(s) )u(s)ds  .  (2.4) 

The  map  f  can  be  thought  of  as  the  composition  defined  by 

▼  ^(UjxMt)  ■  (u(t)  ,f(x(t)  ),G(x(t) ) )  , 

,2<tt,y1,y2,(t)  ■  io  *i(,)<!lB  +  Jo  y2(8)u<B)dB  * 
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Clearly  ¥  1  is  C1  and  f  2  is  bilinear.  Hence  ¥  is  C1  and  the  saae 
holds  for  ♦,  because  of  the  implicit  function  theorem  ([1],  pg.  27S).  An 
application  of  Theorem  1  yields 

Theorem  2  -  Let  u  be  an  admissible  control  for  the  system  (8)  and  assume 
frhat-  *(t,u)  e  3R(T).  Then,  for  every  tangent  vector  v„  generated  by  a 
(possible  high- order)  admissible  variational  family  YQ  for  u,  there  exists 
and  absolutely  continuous  nonrero  n-vector  valued  function  t  ♦  X(t)  on 
[0,T]  which  satisfies 

X(T)  •  <  0  (2.5) 

X(t)  -  -X(t)[fx(x(t,u))  +  Gx(x(t,u))u(t>] 

X(t)G(x(t,u)  )u(t)  -  max{X(t)G(x(t,"u)  )u>  u  e  0>  (2.7) 

for  almost  every  t  in  [0,T]. 

3.  Proof  of  Theorem  1 

Assume  that  0  e  int  oo{vQ, . . .  ,vk> .  From  the  family  choose 

n  ♦  1  nontrivial  tangent  vectors  vo»***'vn  8UCh  ***** 

0  e  int  cotvl . v'}.  Notice  that,  if  v„  is  not  one  of  the  chosen  vectors, 

0  n 

any  other  vector  can  play  its  distinguished  role.  For  notational  convenience, 
assume  that  0  e  int  co{vQ,...,vn} .  Relying  on  the  fact  that  » • *  *  *Yn  have 
order  1  we  now  prove 

Lemma  1.  The  family  of  admissible  variations  F  ”  ~ 

Proof.  Define  the  scalar  function  o  by 

o(C)  ”  sup{luQ(C)  -  ul/z»  0  <  C  <  C)  •  (3.1) 

Clearly  a  is  a  continuous,  nondecreasing  function  with  o(0)  »  0.  By  (2.2), 

far  Z  >  0  smell  enough  we  have 

lu0(C)  -  ul /Z  >  |v0I/2ID^(u)I  . 

Therefore  there  exists  a  Z  >  0  such  that 


(3.2) 


(3.3) 


(• 


|v0|c  A 


)  <  o(5)  <  1,  5/«(C>  <  1 


2Id+(u)I 

for  all  5  6  (0,5).  Define  u(c,5)  on  An  x  [0,51  by 

n 

u(c,5)  -  «0(c05)  +  I  et(C/a(())[ui(a(Cn  -  u0(c05>] 


(3.4) 


if  0  <  5  <  5  ,  u(c,0)  -  u  . 

By  (3.3),  u(c,5)  ie  well  defined  and  takes  values  inside  U,  being  a  convex 
combination  of  members  of  U.  As  5  ♦  0,  Ug(c,5)  tends  to  uT  and  each  term 
inside  the  summation  in  (3.4)  tends  to  zero  uniformly  w.r.t.  c.  Therefore 
u  depends  continuously  on  the  parameters  c,5*  To  show  (1.7)  we  write 


♦(un(c,5))  -  ♦(u)  +(u(c,5))  -  +(uQ(c  5)) 


4(u(c.5) )  -  4(u)  _  1^0 

K  5 

As  5*0,  the  first  term  on  the  right  hand  side  of  (3.5)  converges  to 

c0v0.  The  second  term  can  be  written  as 


(3.5) 


ij  D*(fl-u(c,5>  +  (1-8)  «0<c05))  •  (u(c,5)  -  uo(co5))d0 
1  n 

•  J0[i*(u)  +  X(e,C/0)J  •  {  ci(1/a(5))[ui(o(5))  -  u0(c0C)]}dS  . 


(3.6) 


The  continuous  Frfcchet  differentiability  of  0  lollies  that  x(°*C»0)  ■ 
D0(0»u(c,5)  +  (1-6)  u0(cQ5))  -  D$nT)  is  a  continuous  linear  operator  whose 
norm  tends  to  zero  uniformly  in  c,  t  as  5  ♦  0.  Observe  that 

(1/a(5))»ui(o(5))  -  u0(c05)»  <  d/a(5>)  *^(0(5))  -  ul  + 


(3.7) 


V, 

(1/o(5) )luQ(c05)  -  ul  <  +  luQ(cQ5)  -  ul  2 

for  some  finite  constants  k^  (i*1,...,n),  because  the  u^  have  order  1 
and  by  (3.1).  The  limit  as  5*0  of  the  last  term  in  (3.5)  is  therefore 
give  *. 
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(3.8) 


n 

li*  D*(u)  •  l  <c./a(C))  (u  (a(£) )  -  u)  . 
5-0  i-1  1  1 


By  the  definition  (2.2)  of  tangent  vector,  one  hae 


v  -  lim 
1  5*0 


*(u  (O)  -  ♦(u) 


lim 

5-0 


D^(u)«(ui(C)  -  u)  +  o(5) 
_ 


-  lim  D*(u)*(u  (5)  “  u)*5 
5-0  1 


(3.9) 


Indeed  u^  is  a  first  order  AVF ,  hence  the  term  o(5),  which  is 
infinitesimal  of  higher  order  w.r.t.  Iu^(5)  -  HI  as  5  +  0,  ia  also  of 
higher  order  w.r.t.  ?.  Comparing  (3.9)  with  (3.8)  one  concludes  that 


lim  [♦(u(c,C)  -  ♦(u)]  r1  - 
5-0 


S  n 

cnvn  +  I  c  lim  D*(u)  •  tu.  (<*(£>)  -  ul/o(5)  -  £  c.v, 
i-1  1  5-0  1  i-0  1  1 


uniformly  in  c. 

Using  the  above  lemma,  the  proof  of  Theorem  1  can  now  be  completed  by  an 

application  of  Brouwer's  fixed  point  theorem.  Let  6  -  dist(0,  3co{v  , ...,v  }) 

u  n 

and  choose  Cq  >  0  so  snail  that 

n 

|+(u(c,50))  -  #(u)  -  50  l  c  v  I  <  5Q*$/2  (3.10) 

i-0 

for  all  c  e  An.  Consider  the  injective  map  a  :  a"  ♦  r”  defined  by 

n 

o(c)  -  f(u)  +  50  l  c  v  . 

i-1 

For  x  e  B(^(u),  5„«)  define  F(x)  -  ♦(u(o~1 (x) ,5Q) ) .  By  (3.10), 

|F(x)  -  x|  <  £g6/2.  For  each  xQ  e  B(+(u),  5Q6/2),  an  application  of 
Brouwer's  theorem  ([8]  pg.  251)  now  implies  the  existence  of  some 
x  e  B(+(u),  CqS)  for  trtiich  F(x)  -  Xq.  Hence  B($(\i),  5^6/2)  £  4  (U )  .  Q.E.D. 


i 
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4.  Proof  of  Theorem  2. 

Suppose  that  the  conclusion  is  false.  Then  there  exists  an  admissible 
variational  family  Yq  for  U  possibly  high  order,  that  generates  a  tangent 
vector  vQ  such  that,  for  every  absolutely  continuous  A(»)  satisfying  (2.5) 
and  (2.6),  one  has 

A(t)*G(x(t,d)  )#tt(  t)  <  max{X(t)»G(x(t,“u)  )»u;  u  e  0}  (4.1) 

for  t  in  a  subset  J  £  [0,T]  having  positive  measure.  For  each  vector 

p  f  0  with  h'Vp  <  0,  let  A^(«)  be  the  unique  solution  of  (2.6)  for  which 

X  (T)  *  p,  and  choose  a  control  u  S  U  such  that 
p  p 

X  (t)*G(x(t,u) )*u  (t)  =  max{X  (t)»G(x(t,u) )u»  u  6  fl}  (4.2) 

n  h  0 

for  a.e.  t  e[0,T].  The  continuity  of  A^ ,  G  and  x(*,u)  and  a  selection 

theorem  [7]  imply  that  such  a  measurable  u  exists.  Define  an  AVF  Y  for 

n 

u  by  setting 

u(C,'>  «  5u  (•>  ♦  d-|)B(»>,  V  5  e  [0,1]  .  (4.3) 

Then,  for  every  £,  u(£)  e  U  because  U  is  convex,  and  lu(£)  -  ul/£  • 

0  n 

lu^  -  ul  /  0,  showing  that  Y  has  order  one.  Let  IIT  :  C  [0,T]  ♦  R  be  the 
linear  projection  x  ♦  x(T).  From  the  remarks  made  in  §2  it  follows  that  the 
map  C  ♦  x(t,u(C))  is  the  composition  of  C1  mappings,  hence  the  tangent 


vector  generated  by  the  AVF  (4.3)  exists  and  is  given  by 

v  *  lim  [x(T,u(£))  -  x(T,u)]/?  *  H  »Dt(i(u)»(u  -  u)  ■ 

£-►0  T  n 

M(T,s)»G(x(s,u) )• (u  (s)  -vi(s))ds 
*  0  T1 


(4.4) 


where  s  ♦  M(T,s)  is  the  matrix  fundamental  solution  of 


z(t)  ■  [fx(x(t,u)>  +  Gx(x(t,u) ) *u(t)]z(t) 
with  M(T,T)  ■  I,  and  where  ^  is  the  input-output  map  defined  above 
(2.4).  By  (2.6)  the  inner  product  of  P  and  v  is 


n*v  -  J*  X  (T)M(T,s)»G(x(s,u))*(u  (s)  -  u (s) }ds 

o  n  n 


(4.5) 


in  X  (s)*G(x(s,u) )• (u  (s)  -  u(s))ds  >  0 
on  n 

because  of  (4.1).  Hence,  for  every  nontrivial  vector  n  with  n*v^  <  0, 
there  exists  a  first  order  tangent  vector  v  for  which  n*v  >  0.  The 
positive  span  of  the  set  of  first  order  tangent  vectors  together  with  vQ  is 
thus  the  whole  space  rf1.  Theorem  1  applied  to  the  C1  map  4  ”  : 

u  ♦  x(T,u)  yields  x(T,u)  e  int  R(T),  a  contradiction. 


5.  Examples* 

The  assumption  on  the  order  of  the  control  variations  in  Theorem  1  is 
essential.  Indeed,  two  arbitrary  second  order  AVF  need  not  be  summable,  as 
shown  by 

Example  1.  Define  a  time  dependent  system  on  R3  by 

(x^  (t) ,  x2(t),  x3(t))  -  (^2(t)x3(t)u1(t),^>2(t)x:J(t)u2(t)  , 

Vt)u3(t))  *  (5. 

(x1(0),x2(0),x3(0))  -  (0,0,0)  , 


where  t  e  (0,3],  the  smooth  functions  8ati8fY 

vyt)  -  0,  ^2<t)  >0  for  t  e  (1,2]  , 
^2(t)  *  0  for  t  e  [0,1]  u  [2,3]  , 

'^1<t)dt  ■  J*  ^2(t)dt  -  -J2  ^1(t)dt  *  1 


(5.2 


and  the  controls  satisfy  the  constraints 

0  <  uAt)  <  1  (1*1,2),  —  <  u3(t)  <  •  . 

The  reachable  set  at  time  t  ■  3  is  then 
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l 


(5.3) 


R(3)  -  {(x3,x  ,x3)i  x^2  >  0}  . 

Let  XT  be  the  null  control.  Consider  the  two  A  VP  for  XT: 

u(1)(C)(t)  -  (5/z  ,0,C/2  >,  u(2)(C)(t)  -  <0,£*,-£*)  , 

constant  on  the  time  Interval  [0,3].  Notice  that  for  1  ■  1,2 
luU>(C)  -  ul2/C  -  (jJ|u(i)(C)(t)|dt)2/C  -  18  . 

By  setting  h  »  2,  ■  C2  ■  18  In  (1.4)  one  checks  that  u* 1  *  and  u* 


(5.4) 


(5.5) 


are  both  of  second  order.  The  endpoints  of  the  corresponding  trajectories  are 


x(3,u(1><e>)  -  (5,0,0),  x(3,u(2>(5))  -  (0,-C,0) 
Hence  and  generate  the  tangent  vectors 


(5.6) 


v,  -  (1,0,0),  v2  -  (0,-1, 0)  .  (5.7) 

Comparing  (5.7)  with  (5.4),  It  Is  clear  that  these  two  AVF  cannot  be 
sumawble.  In  this  example,  the  set  of  high  order  tangent  vectors  of  the 
special  type  considered  In  [6]  Is  the  cone  T  -  {(0,0,x3>»  x}  e  ■}.  This  Is 
of  course  convex  and  coincides  here  with  the  first  order  tangent  cone.  Notice 


that  the  time  dependency  can  be  easily  removed  by  adjoining  a  new  variable 


We  now  illustrate  a  non  trivial  application  of  Theorem  2  to  the  study  of 
optimality  of  bang-bang  controls. 

Exasple  2.  Consider  the  three  dimensional  autonomus  system  with  scalar 
control  u(t)  e  [-1,1]: 


(x1,x2,x3)  -  (u,x^ ,Xj+kx^/2 )  , 


(x1(0),x2(0),x3(0))  -  (0,0,0) 


(5.8) 


The  adjoint  equations  for  this  system  are 


(  1 ,  2»  3 )  *  ^  -*3»0) 


(5.9) 


If  |k|  <  1,  then  a  theorem  of  Sussmann  [9]  yields  the  existence  of  a  T  >  0 
such  that  every  time  optimal  control  u(»)  on  [0,T]  is  bang-bang  with  at 


f 


nost  two  switch Inga.  If  |k|  >  1,  the  above  result  does  not  apply.  Indeed, 
for  every  T  >  0,  there  exist  bang-bang  controls  u  that  satisfy 
Pontryagin' s  necessary  conditions  for  optimality  and  have  an  arbitrarily  large 
number  of  switchings  on  [0,T].  In  order  to  construct  a  regular  feedback 
synthesis  for  (5.8)  it  is  important  to  rule  out  the  optimality  of  these 
controls.  In  this  direction  we  prove 

Proposition  1.  Assume  k  >  1.  Then  every  bang-bang  control  TT  assuming  the 
value  +1  on  a  positive  neighborhood  of  the  origin  is  not  optimal  after  its 
third  switching  time. 

Proof.  Let  "u  be  a  bang-bang  control  which  is  initially  +1  and  has  at 
least  3  switchings,  and  let  0  <  t^  <  tj  <  t^  be  its  first  three  switching 
times.  Fix  any  T  >  t3,  smaller  then  the  fourth  switching  time  if  there  is 
any.  we  will  prove  that  x(T,u)  e  int  R(T).  If  the  classical  Pontryagin* s 
necessary  conditions  do  not  hold  for  H  on  [0,T],  we  are  done.  Otherwise, 
let  A(t)  ■  (A^t),*  (t),A  (t))  be  a  nontrivial  adjoint  variable  satisfying 
(2.6)  and  (2.7),  given  in  this  case  by  (5.9)  and 

1T(t)  ■  sgn  A^t)  a.e.  on  [0,T1  (5.10) 

respectively.  Our  first  task  is  to  compute  A(T).  Set  tQ  ■  0,  ■  T.  From 

(5.9)  it  follows  that  the  map  t  ♦  A ( t)  is  C1  on  [0,T]  and  piecewise 
analytic  on  lt^„j,t^]  (i“1#  ...,4).  In  particular,  we  have 

X3(t)  -  X3(0),  X2(t)  -  X2(0)  -  tX3  (5.11) 

X^t)  -  X3(1  -  k  sgn  A^t))  a.e.  on  [0,T]  (5.12) 

X1(t1)  -  0  (i  -  1,2,3)  .  (5.13) 

Hence  X^(t)  is  a  polynomial  of  degree  2  in  t  on  each  subinterval 
[tj_j,t^J.  If  X ^ ( t )  *  0  for  some  t  e  (t^tj),  then  we  would  have 
A(t)  =  0,  against  the  assumptions.  Thus  A^(t)  f  0  for  <  t  <  tj*  By 
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( 


(5.13),  Xt  is  not  identically  sero.  Together  with  (5.12),  this  implies 
Xj  >  0.  Multiplying  X^  by  a  positive  scalar,  we  can  therefore  assume 
X3(t)  s  1.  This,  together  with  (5.12)  and  (5.13),  determines  X^(t) 


uniquely: 


x^t)  -  1  *  ~  (t-t^lt-tj),  for  t  e  ltt,t2l 


X^t) 


1  -  k 


(t-t2)(t-t3),  for  t  e  ft2,t3J  . 


(5.14) 


(5.15) 


The  computation  of  X,j(t2)  u*i-n9  alternatively  (5.9),  (5.14)  and  (5.15) 


yields 


X1(t2)  “  “X2(t2)  "  kxi<t2>  "  ”X2{t2)  "  k<2t1"t2)  " 


2  (t2~t1>  “  *"§  (t3"t2)  * 


(5.16) 


Notice  that  the  above  expressions  coincide  because  X  is  C1 .  Prom  (5.9), 


(5.16)  we  deduce 


X2(T)  -  t,<1  -  3k)/2  +  t2(1  ♦  k)/2  -  T  . 


(5.17) 


For  notational  convenience,  set  a  ■  tj,  b  ■  tj^t^i  c  ■  tj-tj,  d  “  T-t-j. 
So  far,  we  have  proven  that,  up  to  a  positive  scalar  factor,  there  exists  a 
unique  adjoint  variable  X(t)  that  satisfies  (2.6)  and  (2.7)  on  [0,T].  Zn 


particular,  (5.17)  and  the  last  equality  in  (5.16)  yield 

X(T)  -  (X 1  (T ) ,  -ka  ♦  *  ~  ^  b  -  c  -  d,  1)  , 

(k  ♦  1)b  ■  (k  -  1)c  . 


(5.18) 


(5.19) 


the  second  part  of  the  proof  consists  in  the  construction  of  a  second 


order  AFV  for  "u  generating  at  t  •  T  a  tangent  vector  v  having  a  positive 


inner  product  with  X(T).  A  lengthy  but  elementary  computation  (see  Appendix) 


shows  that  the  control  u  steers  the  system  from  the  origin  to  a  point 
x(T,1T)  whose  coordinates  are 


r 


Xj(T,H)  ■•-b+c-d 


9 


*2  “  T2/2  -  (b+c+d)2  +  (c+d)2  ‘  d  ' 

(5.20) 

J«3<T,tf)  -  [T3/2  -  ( b+c+d ) 3  ♦  (e+d)3  -  d3)/3  + 

I*3  +  (b-a)3  +  (c-b+«)3  +  (d-c+b-a)3/2]k/3  . 

For  t  e  (Of T]  and  %  >  0  suitably  small  dsfina 

u(5)(t)  -  1  if  t  e  (0,a+C^c)  u  [a+b+5^  (b+c),  T-df^  b)  , 

1a  1a  1a 

u(5)(t)  -  -1  if  t  6  (a+v2c,a+b+£/2  (b+c) )  u  [T-d+^d.T]  . 


Ths  coordinates  of  x(T,u(£) )  are  thus  obtained  from  (5.20),  replacing 

a,b,c,d  by  a+C^  c,  b+C^  b,  c-£^  c,  d-(/2  b  respectively.  Using  (5.19),  one 

1a 

checks  that  in  the  expression  of  x(T,u(C ) )  all  terms  in  £  £  cancel,  hence 
the  map  C  ♦  u(C)  is  an  AVF  of  u  of  order  2.  The  computation  of  the 
corresponding  tangent  vector  v  defined  by  (1.3)  yields  (see  Appendix) 

v  -  (0,  2,  b  +  c  +  2d  +  k(2a  -  b  +  c))bc  .  (5.21) 

The  inner  product  of  (5.18)  and  (5.21)  is 

X(T)»v  ■  (k  -  1)bc2  >  0  . 

This  shows  that  the  necessary  conditions  for  extremality  given  in  Theorem  2  do 
not  hold  for  u,  hence  x(T,u)  e  int  R(T).  For  any  T  >  t3,  u  is  not  time 
optimal  after  T,  therefore  u’  is  not  optimal  after  its  third  switching 
time. 
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APPENDIX 


For  the  control  u  considered  in  Example  2,  the  coordinates  of  the 

point  x(T,o)  are 
T 

x.j(T,u)  -  JQ  u(  s ) ds  -  a-b+c-d 

x2(T,'ff)  -  (t-s)u( s)ds  -  T2/2  -  (b+c+d)2  +  (c+d)2  -  d2 

X3  (T  ,TS)  -  iT-~gl-  u(s)ds  +  |  Jj  (x,  (a, IT)  )2ds 


r.a  _,a+b  .a+b+c  _  ,T  1  LT-s) 
u0  ;a  *  a+b  *  a+b+c  *  2 


ds 


+  s2ds  +  J*+b(2a-s)2ds  +  j*|^+C(s-2b+2a)2ds  +  J^+b+c(2a-2b+2c-s)2ds] 

.  rll  .  lfefc+fl)3  +  (c+d)3  _  dii 

l6  3  3  3  J 


.  id  1 2aL  .  2(fl-b)3  (d-c+b-a)3: 

+  2  «•  3  +  3  +  3  +  3  j* 


2  1  3  3  3 

The  coordinates  of  x(T,u(€))  are: 


x,j(T,u(C))  ■  x^  (T,u) 

x2<T,u(C))  ■  T2/2  -  ( b+c+d)  -  cC^2  )2  ♦  ( c+d-(b+c)5^2  )2 

I4  2 

-  (d-bC'2)  -  x2(T#1TJ  ♦  2bcC 

x3<T,u(C>>  -  j  [t3/2  -  {b+c+d  -  j3  +  (c+d  -  (b+c)*^  )3 
-  (d-b«/2  )3]  ♦  |  [(a+cC/2  )3  +  (b-a+(b-c)C/2  )3 
♦  (c-b+a-b^2  )3  +  (d-c+b-a) 3/2 ] 

■  x3 (T,u)  ♦  [b2c+bc2]C^2 ♦  klb2c-bc2]C^2 
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+  tbcWc+2bcdJ5  ♦  k [2abc-b*c+bc^J  +  OlC'*) 


.3/2, 


XjtT/u)  +  be  tb+c+2d+-k  ( 2a-b+c )  ]  C 


because,  by  (5.19),  b+c+k(b-c)  ”  0.  This  yields  (5.21) 
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